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ABSTRACT 

In the spring of 1973, a standardized test of reading 
and mathematics skills was administered to 564 grade 3 pupils 
distributed among two open plan schools (155 pupils) and seven 
conventionally constructed schools (409 pupils) • The groups were 
matched on IQ, geographic location, the academic qualifications of 
their teachers, and average class load. This was the third and final 
year of a longitudinal ability and achievement study of this pupil 
cohort. As in the previous two years, the marginal differences in 
achievement as disclosed by test results were neither consistent nor 
significant. Over the three schools years, beginning in September 
1970^ no significant differences were found in the academic ability 
and scholastic achievement levels between the pupils in the two sorts 
of architectural settings. No consistent patterns were discernible; 
some differences might be attributable to factors other than 
architecture, since it was impossible to control all the variables 
(e.g., years of teaching experience) that might reasonably have 
affected the learning situations under study. (Author/HLF) 
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READING AND MATHEMATICS ACHIEVEMENT OF GRADE 3 PUPILS 
IN OPEN PLAN AND ARCHITECTURALLY CONVENTIONAL SCHOOLS 
THE THIRD YEAR OF A LONGITUDINAL STUDY 

Brlon Burnham, Research Coordinafor 
Division of Planning and DeveiopmePt 
The York County Board of FducaHon 

SYNOPSIS 

In fhe spring of 1973 a standardized test of reeding and mathemaHcs skills 
was administered to 564 grade 3 pupils dislributed among tv/o "open plan" schools 
(155 pupils) and seven conventionally conrructed schools (409 pupi!i>}. The groups 
Were matched on IQ, geographic location, the academic qualifications of their 
teachers, and average "class load." This was the third and final year of a longitud- 
inal ability and achievement study of this pu^^ii cohort. 

As in the previous two years, the marginal differences in achievement were 
neither consistent nor signfficanf . As in grade 1 (1971) and grode 2 (1972), pupils 
in the open plan schools were, on the averoge^ perhaps fractionally better readers. 
On the other hand, the pupils in the traditionally built schools scored hicjher In 
mathematics by about the same insignificant margin (about one raw score point on 
a battery of 1 15 items). 

Over the three school years, beginning in Sept. 1970, no significant differ- 
ences were found in the academic ability and scholastic achievement levels between 
the pupils in the two sorts of architectural settings. Previous and parallel sl-udies' 
have investigated other dimensions pupils' creativity and curiosity; pupils' 
attitudes toward school; teachers' expectations and the possible effect of these 
expectations on pupils* achievement; pupils' development of moral reasoning power 



The earlier studies in fhis series are noted on the first page of this report. 



in the two f,eitings; pupils' opportunities to ^hcio In docir.Ion-makin;.], inlnato 
learning activities, to raise pertinent qu^xMons and to discover, their own answers,, 
etc. While the marginal diFferences have \ended fo favou" pup^Ls if; tiio open plan 
schools, this was not the case in all instonces. The differences were of a magnitude 
which could be considered chance occurrences. No consistent parlerni; are discern* 
able; some differences may be attributed to factors other than architecture,, as if was 
not possible to control all the variables (e.g. • years of teaching experinnce) which 
might reasonably affect the learning situation!, under study. 

DETAIL 

(a) Purpose of this Series of Studies and Some Eorly Findings 

When the York County Board of Education came into being in 1969, it in- 
herited four open plan schools which had been designed by predecessor elementary 
school boards. The new beard, both trustees and administrators, could not immed-- 
lately say v/hether these schools featured more than architectural innovation, whether 
they also practised ''open education" and, if so^ what that entailed. The educational 
effectiveness of these new schools was also to be determined. 

A series of interrelated studies was begun in ] 969-* 70, some undertaken co- 
operatively with external researchers. If was hoped that. the educational nature of 
"openness", might be clarified, and that it might be possible to determine the extent 
to which open education practices prevailed in older, conventfona!ly constructed 
schools. 

It seemed desirable to identify the behavioral outcomes educator^^ might ex- 
pect of open education programs and to defermine v/hether desired objectives were 



b^ing met. it also seemed essentiol \o determine whether, iii itrivint, for th^?i^ 
particular yoals, open plan schools hod undesirable s!de-e:fects . For instance, 
v/ere they offering a less effective program, as judged by **^r<^dirIona{'^ yardsticks 
(such as achievement !n reading and mathematics skills', when compored v/tth other 
schools v/hich resembled them in some major particulars bur not in a-'chitecture and 
its (assumed) concdrrimitan t differences In progrorn organization? 

In 1969-1970 the first titles in this present series were published. These 
works helped to define the nature of open education, both ot theoretical and 
practical levels. Gase studies of pupils at ail elementary grade levels in both 
open plan and matched "control" schools were conducted. In the spring of 1970 
it was possible to report findings to the board. Pupils in open plan schools were, 
in the opinion of the observers (public school principals), more likely: to be allowed 
to initiate learning activities including those which reflected their own interests; to 
be given and to put to good use some responsibility for their own learning; to raise 
pertinent questions; and to participate in cooperative planning with teachers; thon 
were pupils in the matched "conventional architecture" schools. 

These cose studies also showed that some "open educotron'' concepts and 
practices were embodied in the programs of schools with conventional architecture. 
Pupils in both settings had equal opportunity to display personal responsibility, for 
instance, and they displayed equal regard toward others, in one of the two open plan 
schools, some degree of "structure" was provided for many pupils, especially for those 
identified as needing remedial teaching or special education programs* A recheck In 
1973 found this "structuring" hod been continued, even extended. About 40 per cent 



of the grade 3 pupiis in fhaf on^ open plcn school had ieosl sornr.: of i-hefr progiam 
in an orchltecl-uraily and programrnaKcoll)' non--open sei-r^ig ov.c^ faihton. 

In fhe GUtumn of 1970 the board aufhorized studies into oi-he^ dimensions of 
education v/here \f v/gs thought tliof open plcn schooh migiit produce difFerent ou^- . 
comes. The studies Into differences in creativity and curiosily, attitudes and ex- 
pectations, and into moral reasoning (inf erpersonal valuing) power, nave proceeded 
into 1973, with interim or final reports as indicated elsewhere. /\\ present, only a 
report on attitudes and "expectations'' remains outstanding, in these various studies 
to date, np consistent differences hove been identified between pupils 'in one setting 
or another. The some conclusion holds for the threo^-yeor study of achievement which 
IS the subject of this report. 

(b) Limitations of this Study 

In previous reports much has been said obout the dangers of over -emphasizing 

the results of tests which measure tlie cognitive (inteffectuol) attainments of rather 

young children. It was observed that, in kindergarten and grades 1 and 2 many 

teachers stress personal and sociof growth, encourage orticuiateness even at the ex^ 
«' — 

pense of correctness, work at 'Veodiness" ikilis rather then at paragraph comprehen- 
sion, and arronge opportunities for concrete experience with materials rather than 
with abstract concepts. Such concerns are less to the point in grade C, however, as 
cognitive skills development is more central to programs at this stage. 

Difficulties with the mechanics of paper --and-penci ! tests were noted in previous 
years. The grade 3 pupiis, qnd the schools too, seemed to find ''^e 1973 testing easy to 
take in stride. There was no evidence of invalid administrations and on item-onafysfs 
procedure provided cross-^checks on the manual scoring of the tests which, this year, 
was done in the Research Office, rather than by the teacher^ii. 



The twin problems oi otfritior. — !o'->s of pjpi-s cuiif g 'He \\u: of o iongii-ud- 
Inal sfudy due to francferi: O'jt o^" *he /..chco! — onW cccreMor Van add{r?on of pupl's 
who transfer info o r^choo? are ronsideiab'e over o three-yeor s^ar;. Vvhiie atii !- 
tion has been moderoie v/iih rospec* ^o ircivifiucl p'joils. ere conveiUioiio! ly buiU 
school was dropped (rorn the study when ifs pcf uiatlon wa? dopieted due fo the con- 
siructlon of another schoo! adjacent to it, [n-rnigrcilon hos been considerable 
especially to fhe open plan schoois. !n one Instance, the closing of small neigh- 
bouring rural schoois caused a dramatic jump in enroimenr^ After such ''new'^ pupils 
had been in either the open plan or conventional schools for two years there was no 
logical reason for excluding them from the study, sove the questionable tradition of 
sfudying oniy i*he "survivors" in long-i-erm sfudies. Cleoiry, the populations in any 
setting at the beginning and end of this study are rother different^ e^speclally qt open 
plan school "B/' which grew over the period from 20 to 46 pupils in the grade under 
study. The alternative, to continue on^y with the survtvorS; vouio overlook the re ;I- 
life facts that families (as weii as ;>ohoo! boundaries) move about, that children are 
normally exposed to more than one style of school orchlfecfurt:: or educational philo- 
sophy, and that schools are expected to ansv/er for the progress of tronsfur-in pupils. 

(c) Metho d 

Much of the detail concernirig the origin and first yeors of this study can be 

o 

found in earlier titles in this sorie.-/^ The foHov/ing resume ir^ intended only as an 
overview of earlier information and to link It meaningfully to the 1973 investigations!--' 



Specifically^ see Studies ^^2, '^5, and ^^6. 
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A study in 1969-70 (reported as A'Day in the Life) he.ped 'o determine 
certain degrees of dissimilarit/ between the Ccunty*s open nfor efernentary schools 
(at that time there v/ere four) and three conventionoiiy built schooiji which resembled 
them in certain other ways. From Experience gained in examining many facets of the 
school's operations, it wao possible to devise guideiines for further studies in which open 
plan and conventionally built schools could be "paired" for the purpose of comparing 
outcomes. School principals were involved in this process and there v/as consensus 
that comparative studies of achievement were most feasible where the following 
conditions could be met. The minimum enrolment of 300 pupils should be spread 
across at least seven years, beginning with Hndergarten (e.g., K-6 or K-8), and 
that the study should be longitudinal, proceading from grade 1 and lusting a minimum 
of three years. The communities should resemble each other (e.g., in socio-economic 
status, geography), preferably being contiguous. Comparisons of achievement should 
be "controlled" by (i.e., take into account) ability measures. The numbers of pupiU 
studied should be as great as possible (i.e.^ whole population of any grade understudy, 
not just a sample) and care should be taken not to exclude "special cases" (e»g,, special 
education classes, transferees) without good cause. From experience, it was thought 
Unlikely that ail conditions v/hich varied randomly (e.g., class toad, teaching experience) 
could be controlled. These variables could be examined in detail If meaningful differ- 
ences in pupil performance were found, in which case there would be some need to 
account for the findings. It was taken as read that standardized tests would need to be 
used, that teachers would be consulted on the appropriateness of the tests, and that usual 
methods of controlled research v/ould be followed. 



!t war- no? considered fea?;ibi<:; iC ^ry the rondorn ass^gnn-on^ of r.up:!: fo 
schools of l"he Iwo r/pe*:;, or 'o se!ec^ schools o* rond:>ni, ho*V'?.vrr 'deal this oppears 
to research fheorlsfs, unfil o sfrono neeo jusj?*''ted ?.vch ocricnr. 

In the autumn of 1970 the princioolf vo' ihe Counf/':- Uvo :ipen p\or ^chcoi? 
which operated programs and of 1/ other (convontlonai architecture) schools 
volunteered to portrcrpate In a three-year longitudinal study of achievement. Be- 
fore the Initial tests (spring 1971) the two open plan schools were ''paired" with a 
total of nine schools which, collectively, were more-cr-iess comparable with res- 
pect to the Variables previously judged important. (The number of "paired" schoo]$ 
was reduced to seven by 1973 due to boundary changes which caused considerable 
alteration in their nature to two scltools,) The nine other volunteer schools served 
to give "background" readings to the various test scores, representing as they did 
the achievement patterns to be found across vhe County. 

For the 1972 testing program^ the open pion and their "control*' (or "paired") 

I 

schools were judged comparable with respect iO the communities they serve;, to the 
academic (cognitive) ability of the pupi! cohort under study, and to ihe qualifica- 
tions of the teachers as wel! as the mean average class loads borne by the teachers. 

All grade 3 pupils in the present study previously took one, or both, of the 
Canadian Cognitive Abilities Test (1970 edition), Primary 1 battery (riiven to grade 1 
pupils in 1971) and the Primary 2 battery (given to grade 2 pupils in 1972). In both 
years Form 1 of the test was administered. These test data were used to reconfirm the 
comparability of the open plan and control groups. 



In those same years ^he pupils also >vrotc Hie Me^ropo^fcii Achievement 
Test {1970 edition) bofferics, Primary 1 (For.r: G) in !971 , and Pr'i.nary 2 (Form F) 
In 1972. The mothimqi^cs and reading batfories vvere given both years, with 
spelling also given :n 1972, Due* fc tnc very riigt) s'^clllno scores in grcdc 2, it 
was decided against using the spelling bortery in grade 3. 

In the spring of 1973, the reeding and mathematics tests of the Elementary 
Battery of the Metropolitan Achievemenh Tests (Form G) v^ere cdmlnistered to about 
1100 grade 3 pupils in 18 schools. This battery is recommended for use from mid- 
grade 3 to the end of grade 4. The reeding tests ccnsi . ed of a word knov/ledge or 
vocabulary section (50 items) and a reading comprehcnsicn section (45 items). The 
mathematics score Is similarly an aggregate of results from a computation section 
(40 items), a mafhemct.ical concepts section (40 items), and o problem-solving 
section (35 items) . 

(d) Findings 

For 1973,. OS wifli )he preceding two years, onciyses of variance hove been 
carried ou' for <hree difvereil* comparlrons. Firsi , fhi^ means of scores attained in 
the tw o open plon schools ware compared v-'Ith me^ans cbtarnec in the seven control 
school Second, ihe menns of each of ti^e open pjo:. school s v^ere compared with the 
means of that schooi's controls . Flnouy, the means of a(i the pupils in the open plan 
schools were compared with the means of the pupils in oil 16 schools. The means o^ 
the pupils in th-ir seven control schools were similarly compared with the means of the 
pupils in all 18 schools. 



As In previous years, the meons of the pupils in rho open plon ond conven- 
tional schools did not differ in either c prccMcal or statistlcaHy significant degree. 
As Table 1 shows, the mean rending scores differed by cr\r^ rov/ score point (52.4 vs 
51 .4) on a 95-item battery ^ and favoured the open pian pupils. On the mathematics 
battery of 115 items, the difference this time fovoured the control school grade 3 
population, 62.6 to 61 .5, or |ust better thon one raw score point. The very consider- 
able variance of scores within groups was noted as in 1971 and 19/2. 



TABLE 1: ACHIEVEMENT OF GRADE 3 PUPILS IN OPEN PLAN AND 

ARCHITECTURALLY CONVENTIONAL SCHOOLS 
(GROUPED BY TYPE) 



School Type 


No. 
Schools 


No. 
Pupils 


Mean 
IQ 


M un 
Reading 


Achievement 

Mathematics 


Open Plon 


2 


155 


105^ 


52.4 


61.5 


Conventional 


7 


409 


106* 


51 .4 


62.6 


Count/ Sompla 


18 ' 


1035 


109* 


57.2 


70.0 


Test Norms 






100** 


53.0 


62.0 



* On Canadian Cognitive Abilities Tests 
** On Otis-Lennon Mental Abilities Test 



Comparisons were mode between mean scores of each open plon school and ' 
its controls. Open plan school "A" pupils outperformed pupils in its controls signi- 
ficantly in reading (.01) hut not in mathematics. Pupils in open plan school "B" 
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performed markedly less well in reading (iign'if'tcant at .01) and mafhemat-ics (.05)/ 
reversing whaf hod been observed in bofh the preceding ysars. Table 2 provides 
defoils. 



TABLE 2: ACHIEVEMENT OF GRADE 3 PUPILS IN OPEN PLAN AND 
ARCHITECTURALLY CONVENTIONAL SCHOOLS 
(PAIRED) 



School 


No. 

Schools 


No. 
Pupils 


Mean 
IQ 


Mean A 
Reading 


chievement 
Mathematics 


Open Plan "A" 


1 


10? 


105 


57.2 


61 .6 


"A's" Controls 


3 


190 


108 


50.8 


61.2 


Open Plan "B" 


1 


46 


106 


45.4 


61 .4 


"B's" Controls 


4 


219 


105 


51 .9 


64.0 



As Table 1 shows, the means of pupils in the open plan schools and also the 
pupil means in their conventionally built controls were substantially less than the 
mean average scores attolnod by all grade 3 pupils in the 18 schools in this testing 
prociram,' Even when the differences in ability ("IQ") are taken into account in the 
analyses, the achievement differences are still greater than could reasonably be 
attributed to chance variations (p = .05). 

The publi.^her's test norms are included in Table 1 . The achievement scores 
in the nJne schools under study do not vory much from the norm group scores. 

In previous years achievement scores hove been reported as i^rode equivalent 
(GE) scores and, sometimes, also cjs percentile {%5le) scores. In Table 3 the mean 
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achievement scores, by school, for each subtest and for "total reading" and "total 
mathematics" are given as grade equivalents. In addition, each mean raw score for 
each test, by school, has also been treated as Jf it were an individual score, and a 
percentile ranking found for that score. These converted scores will be mainly of 
interest and use in schools where such data have been compiled over the life of this 
study. 

In receiving the report of the grade 2 achievement testing program, the 
York County trustees asked whether certain uddltionai information could be included. 
Specifically, data were requested on the experience and qualifications of the teachers 
of the pupils under study, and the ratio of men to women teachers. They also wished 
to know whether the open concept schools had "closed" areas where "slow learners" 
were placed. 

The definition of "qualifications" and '^experience, " to the layman, may 
present some semantic problems. For this study we have held to fhe legalistic criteria 
used by the board for pay purposes. Depending on preservice education and training, 
every elamentary school teacher is categorized numerically, 1 being the minimum and 
4 the maximum category. Degree status is reflected in the category scheme. Exper- 
ience is calculated in /ears (or partial years) and normally corresponds to fhe number 
of years previously employed as a teacher (or closely related activity). 

Average class load was calculated by school and by school type. "Class load" 
represents the octual number of pupils in the charge of any teacher. Or, in the case 
of open plan schools, it may represent the number of pupils supervised by a team of 
teachers, divided by the number of teachers. In some schools where there were mixed 

ERLC 



-13- 

grades (or continuous progress, ungraded) dosses, the class load definition still holds, 
but it is understood that not a!! pupils would necessarily be characterized as "grade 3" 
pupils. 

As Table 4 shows, when the mean averages for the open plan schools (on the 
one hond) are compared with the averages for the conventionally built schools (on the 
other), the qualifications and class loads are nearly the same. The control schools 
do have a marginally better class load factor, and their teachers are of somewhat higher 
average category, but the difference is slight. 

The average teaching experience of the control schools' staff, 6.2 years, is 
markedly greater (nearly 150 per cent) than that of the open plan staff, 4.2 years. 
The difference needs to be interpreted in the light of another factor. In open plan 
school "B," a change of staff occurred at the beginning of January. The replacement 
teacher (a degree holder but v/ith only one yearns experience),' a male, was just 
returning to teaching. 

The data on the ratio of male to female teachers, and the number of degree 
holders, is given as requested. This data base is too thin for much more than personal 
judgment. 

More meaningful are the differences in experience and class loads* In open 
plan school "A" some 108 grade 3 pupils (mean IQ of 105) were supervised by only 
three teachers, but achieved as well as pupils (mean IQ of 108) under teachers with 
more experience and lighter class loads in their control schools. In open plan school 
"B, " where a relatively light class load existed, pupils did not perform as well as 
pupils of comparable ability but who had better qualified and more experienced teachers. 

ERIC 
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The best by-school performances of all came from pupils of lower (for this cohort} 
average ability (100), average class load (30), but high feagher experience 
(11,5 years). 

The range of experience differed between the two types of school. The 
open plan school teachers had from one to seven years' experience, while In the 
other group the experience ranged from no years to 18 years, 

DISCUSSION 

The longitudinal achievement studies were orlginaliy undertaken for several ^ 
reasons, among these the voiced fear that achievement in traditJonat dimensions (such 
as reading and mathematics) might be socrificed in open architecture settings • 

At this juncture the only reasonable interpretation of the achievement dota 
gathered over the years is that we must look elsewhere for differences, if they are to 
be found in the Primary Division, 

Perhaps one needs to look at Individual cases rather than at group data. 
For instance, case studies of childre'> not promoted (or placed in special education, 
more likely) or of children who have done exceptionally welly, might throw light on 
the sorts of program specifics which correlate with success or failure of different sorts 
of pupils. 

Given the persistent "no significant difference" findings, pluu the cumula- 
tive attrition-^accretlon threat to the study^s validity, this seems the time to end this 
inquiry t Since all grade 4 pupils will be tested with the Metropolitan Achievement 
Test batteries in the spring of 1974, it v;ould be possible to work through the data 
when and if the need is feit. 



At this point in time many other Jurisdictions are reporting studies on open 
education. It would perhaps be useful to devote research attentions to these studies 
before a new cycle of investigation is decided upon. This might also be an appro- 
priate time to bring the "second generation" of York's open plan schools into purview 



